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SYSTEM FOR CUSTOMIZING MUSICAL EFFECTS USING DIGITAL SIGNAL 

PROCESSING TECHNIQUES 



Background Of The Invention 

!• Cross Reference. 

[0001] This application claims the benefit of U.S. Provisional Patent Application Serial No. 
60/260,048, filed on January 5, 2001, and is incorporated by reference. 

2. Field of the Invention. 

[0002] The invention relates to audio signal processing and more specifically to a system 
for musical instrument signal processing that creates customized effects through mathematical 
manipulation of existing effects such as amplifier or loudspeaker cabinet simulation effects. 

3, Related Art. 

[0003] During the process of creating music, musicians have always searched for the right 
way to express their musical ideas. Just as a composer will use different instruments within an 
orchestra to express music, an electric musical instrument player will choose a variety of signal 
processing effects to achieve a desired sound. In most cases, the amplifier is the major 
contributor to the resulting sound, with each brand and model of amplifier having its own 
characteristic sound. For example, it is not uncommon for an electric guitarist to use several 
different amplifier combinations in the recording studio during a recording session to achieve 
desired sound effects. Two or more amplifiers may even be used at the same time to achieve 
desired sound effects. 

[0004] Electric guitar amplifiers were introduced in the 1940s and for decades their basic 
design remained relatively unchanged. These analog amplifiers have evolved to add tone 
controls, channel switching, and analog effects including reverb, tremble, and chorus to name a 
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few examples. Yet, the core guitar system has remained the same: an electric guitar is connected 
to an am{)lifier and then to a loudspeaker for broadcasting the sound after the audio signal from 
the electric guitar has been processed at the amplifier. If the guitarist wanted a different sound, 
he would use a different guitar, amplifier, or loudspeaker. 

[0005] Eventually, guitar players began inserting additional guitar effects produced by other 
signal processing devices into the signal chain from the guitar to the loudspeakers to obtain a 
wider variety of tonal characteristics or sound effects. The first and simplest guitar effects 
processing devices were analog pedals inserted between the guitar and the amphfier. As they 
evolved, a variety of both analog and digital single effects were available to the musician either 
as a floor pedal or a rack mounted signal processing device. Such effects pedals and rack 
processors added variety in tonal possibilities that were used by many guitarists to provide a 
plethora of effects using processors between their guitar and amplifier. The shortcomings of this 
approach were evident in the overall degradation of the guitar signal passing through so many 
individual signal processors. Also, the amount of time it would take to switch fi-om one sound to 
another by adjusting each individual processing device was a limitation for the musician. 

[0006] As technology has advanced, effects processor products such as the DigiTech 
DSP128 (released 1987) combined many effect processors into a single programmable unit. 
These multi-effects processors offer an integrated digital signal processor (DSP) and a simple, 
single user interface that allows the musician to use a variety of signal processing setups. For 
example, the musician may save sounds to one of several preset program locations and recall 
them at will, A limitation of this type of processor, however, lies in the complexity of choosing 
a desired sound among the inmiense number of possibilities that are offered. 

[0007] The current state of the art for musical signal processing known to the musician is 
amplifier modeling. This type of processing system combines many tone shaping effects from a 
multi-effects processor into a single effect that will approximate the. characteristics of well- 
known "classic" amplifiers that guitarists or other musicians desire to use. There are both 
modeling guitar amplifiers and modeling signal processors. Instead of buying and using several 
different amplifiers, a guitarist can use a modeling amplifier to approximate the tonal 
characteristics provided by selected "classic" amplifiers. Some modeling amplifiers, such as the 
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Johnson Amplification JM150 (released 1997), even allow the user to simulate using two 
different classic amplifiers at the same time. A modeling signal processor has the same amplifier 
modeling effects as a modeling amplifier but does not contain any power amplifier or 
loudspeakers. These devices can be used in a number of ways ranging fi-om adding modeling 
capability to a non-modeling amplifier, allowing direct recording of an amplifier sound without 
ever having the sound be sent through speakers, and even allowing the guitarist to plug directly 
into a public address ("PA") system for a completely guitar amplifier-firee setup during a live 
performance. 

[0008] ... Although modeling systems allow a guitarist to get to the sound of a "classic" 
amplifier faster by combining many control parameters into a single "model select" control, they 
significantly reduce the number of possible sounds that can be achieved since the user is limited 
to the models provided by the product. Also, another limitation is that even if the modeling 
amplifiers are perfect recreations of the original amplifiers, the tonal characteristics can only be 
as good as the original amplifier. By only modeling known physical systems, the resulting 
model does not take advantage of tones that can be created without the physical constraints 
imposed by the materials and components used to construct these systems. Because these tones 
are based on mathematical models, the output from the digital signal processor of each product 
will sound identical. The net result of this is that musicians have a dramatically reduced number 
of tonal possibilities to choose and that the music being performed or made with these products 
is less likely to be tonally diverse. What is needed is an audio signal processing system that 
provides various tonal processing tools to generate a virtually unlimited number of models with 
new tonal characteristics. 



Summary 

[00091 This invention provides a system capable of customizing musical instrument signal 
processing enabling the production of multiple tonal characteristics. A mathematical model of 
tonal characteristics is digitally created based on two or more initial mathematical models of 
tonal characteristics. Upon simulating a first initial mathematical model of tonal characteristics 
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and a second initial mathematical model of tonal characteristics, a new mathematical model may 
be created. By interpolating one or more coefficients of the first and second initial mathematical 
models and by adjusting a control parameter between a range of the first second value, the new 
mathematical model may be created. 

[0010] When the control parameter is adjusted to the first value (first initial mathematical 
model); the control parameter is adjusted to the second value (second initial mathematical 

model); and the control parameter is adjusted between the first and second values, the 
mathematical model may represent a convergence between the first and second models. As an 
example, either amplifier or . cabinet-speaker effects may be simulated using the above 
methodology, 

[0011] This invention provides the musician with numerous mathematical model options. 
An unliniited number of special effects based on signal amplification and cabinet-speaker effect 
generation may be created. This system allows users to create the atmosphere fi:om the 
signature characteristics of a user employing various amplifiers and/or loudspeakers. 

[0012] This system also provides an infinite number of musical characteristics inherent with 
specific characteristics of known amplifiers or loudspeakers thus broadening the musical artist's 
palette of sounds. This increased flexibility provides the musical artist with the ability to create a 
user-unique sound and not forcing the artist to rely on a sound or model that the manufacturer 
has pre-selected. Simple user interfaces may be provided for performing complex sound 
manipulations and the realistic "touch" and "feel" of real amplifiers and loudspeaker cabinets 
that guitarists desire. 

[0013] This also fosters interchange among users. New sounds can be shared with others via 
the Internet, web pages, user's groups, and the like. These sounds can then be added to a pool of 
existing models of amplifiers and loudspeaker cabinets and can then be used to create new and 
unique sounds. The user may be able to simulate and save the models of amplifiers and 
loudspeaker cabinets that may not have previously been in existence. Once saved, these 
amplifiers and loudspeaker cabinets models may be recalled providing users with a user defined 
sound characteristic signature. 
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[0014] Other systems, methods, features and advantages of the invention will be or will 
become apparent to one with skill in the art upon examination of the following figures and 
detailed description. It is intended that all such additional systems, methods, features and 
advantages be included within this description, be within the scope of the invention, and be 
protected by the accompanying claims. 



[0015] The invention may be better understood with reference to the following figures. The 
components in the figures are not necessarily to scale, emphasis instead being placed upon 
illustrating the principals of the invention. Moreover, in the figures, like reference numerals 
designate corresponding parts throughout the different views. 

[0016] Figure 1 is a block diagram illustrating a system providing customized musical 
instrument signal processing. 

[0017] Figure 2 is a block diagram illustrating an audio signal processing system. 

[0018] Figure 3 is a block diagram illustrating a signal flow path within a signal processing 
device. 

[0019] Figure 4 is a block diagram illustrating one embodiment of an amplifier simulator 
subsystem of the device of Figure 3. 

[0020] Figure 5 is a circuit diagram illustrating the signal pathways for a digital signal 
processor. 

[0021] Figure 6 is a circuit diagram illustrating the signal pathways for a digital signal 
processor, 

[0022] Figure 7 is a circuit diagram illustrating the signal pathways for a digital signal 
processor. 



Brief Description Of The Figures 
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[0023] Figure 8 is a screen display of a graphical user interface for customizing musical 
effects. 

[0024] Figure 9 is a screen display of a graphical user interface for customizing musical 
effects. 

[0025] Figure 10 is a screen display of a graphical user interface for customizing musical 
effects. 

[0026] Figure 1 1 is a screen display of a graphical user interface for customizing musical 
effects. 

[0027] Figure 12 is a screen display of a graphical user interface for customizing musical 
effects. 

Description Of The Preferred Embodiment 

[0028] This invention provides audio signal processing systems capable of generating new 
simulation models by using various complex mathematical algorithms to combine pre-existing 
models. These new "hyper models" may be created with techniques enabling the retention of the 
same level of complexity as the original models and, thus, may become an extension to the 
collection of available models in digital audio signal processing systems. 

[0029] Traditionally, the term model referred to a system that mimics certain sound 
characteristics of another existing system. The term "hyper model" may be used to describe a 
model that extends the description of "model." The resultmg hyper model may describe a 
"model" of an amplifier or cabinet-speaker system that is already in existence, and may also be 
used to describe a new system that may be impractical to physically build. Examples of this 
include changing the virtual size of a guitar amplifier cabinet and speaker system to include the 
size of an entire room or to create the tone of a guitar ampUfier between a closed back 4x12" and 
an open back 2x 1 2"configuration. 

[0030] This invention also provides for "warping" or "morphing". These terms may be used 
to describe a control system to continuously transition the tonaUty of an amplifier, a cabinet- 
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Speaker system, or any other audio signal processing system, from one model to another. This 
invention provides a set of tools that users may use to create new tones by warping between the 
tonal characteristics of multiple models thus creating a hyper model. This new hyper model tone 
can then be saved in a memory storage area and recalled by users at a future date. Therefore, by 
warping or other subsequent manipulation, multiple generations of new models may be created 
based on two prior models, whether they are predefined models provided by the manufacturers 
of the audio signal processing system or ne;wly created hyper models. 

[0031] Although the electrical guitar may be described as a typical musical instrument, to 
one skilled in the art it is understood that similar techniques may be applied to other music 
instruments or sound producing devices. Any device whose audio signal can be digitally 
processed achieving particular composite tonal characteristics generated by traditional amplifiers 
and speakers may utilize these techniques. 

[0032] Figure 1 is a block diagram illustrating a musical signal processing system where an 
audio signal processing system 12 is connected to a musical instrument 14 such as an electrical 
guitar. Also connected to the signal processing system 12 is an output system such as a speaker 
system 16. 

[0033] Figure 2 is a block diagram illustrating the interoperability of the signal processing 
system 12. An audio input 20 may be configured to receive signals from an electrical instrument 
that may can be processed through the signal processing system 12 to ultimately generate an 
audio output signal 22. 

[0034] When the audio input 20 receives the incoming signals, the input signals may be 
filtered by a filter device 23. The filter device may comprise an anti-aliasing filter. The input 
signals may then be converted to a digital representation by an analog-to-digital device before 
transmitting the signals to a digital signal processor (DSP) 26. The DSP 26 may also interact 
with a microcontroller 28 to provide other programming information and controlling signals to 
the DSP 26. These control signals may be used for simulating various known characteristics of 
amplifiers or characteristics of various loudspeakers cabinets. For example, the microcontroller 
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28 may have a MIDI connection to an external source 30 where a particular simulation model for 
a specific type of amplifier may be downloaded to the microcontroller 28. 

[0035] The microcontroller 28 may also control direct display devices such as a display 
screen 32 and LED indicators 34. A memory location 36 may be connected to the 
microcontroller 28 allowing for storing and recalling simulation models as desired by the user. 
The DSP 26 may also have a separate memory location 38 capable of caching or storing various 
data. A multiplexer 40 may also be connected to the microcontroller 28 enabling interaction 
with other components of the audio signal processing system 12 such as control knobs 42, 
buttons 44, and an expression controller 46. 

[0036] After the DSP 26 finishes its processing of input signals, it sends its output to a 
digital-to-analog converter 48, and fiirther to an output filtering mechanism 50. From that point 
on, a level control mechanism 52 may be used to adjust the level strength of the signal and may 
be sent out as the audio output 22. It is understood that the DSP 26 may work closely with the 
microcontroller 28 to process audio signals by receiving programming information. For 
example, a simulated model for a particular classic analog amplifier can be loaded directly fi-om 
the non- volatile memory 36 or downloaded through the MIDI connection to the microcontroller 
to be used by the DSP. Various digital processing techniques may be implemented by the DSP 
26. 

[0037] Figure 3 illustrates a block flow diagram 60 showing a signal pathway within a digital 
signal processing device such as the DSP 26. The audio input firom the instrument 14, such as a 
guitar, may be subjected to preliminary processing prior to reaching the DSP 26. In this 
example, inside the DSP, the audio input signals may be received by a guitar pickup simulator 62 
before being passed to a Wah effect generator 64. Next, a compressor 66 and a pitch/modulation 
effects processor 68 may further modify and modulate the pitch of the signal to a user defined 
degree. 

[0038] The output proceeds into two simulator subsystems: the amplifier simulator 
subsystem 70 and cabinet-speaker simulator subsystem 72. The function of the ampUfier 
simulator subsystem 70 is to produce the tonal characteristics of a simulated amplifier or to 
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create a new set of tonal characteristics based on two sets of tonal characteristics corresponding 
to two known amplifiers. Similarly, the cabinet-speaker simulator subsystem 72 is designed for 
emulating a particular cabinet speaker system, or for creating a unique set of tonal characteristics 
based on two known sets of tonal characteristics, that may correspond to two predetermined 
cabinet-speaker simulation models. Each set of tonal characteristics may be modeled by the DSP 
26 using a mathematical model. By adjusting a control parameter such as a warp control, a new 
model may be created. Details for "warping" between two prior known models to create a new 
one is further described below with regard to Figure 4. 

[0039] Although both the amplifier simulator subsystem 70 and the cabinet-speaker 
simulator subsystem 72 may be connected in a sequential manner, it is not required for the signal 
to be processed through both of them or in such a sequence. For example, before a user performs 
on the instrument 14, the user may select whether both the amphfier warping and the cabinet- 
speaker warping is to be performed, and the specific order. 

[0040] Following one or both of the two simulator subsystems 70 and 72, the audio signal 
path may proceed through an amplifier tone controller 74, a noise gate 76, another 
pitch/modulation effect generator 78, a delay sampler effect generator 80, and a reverb effect 
generator 82. These components apply additional digital signal processing schemes as desired 
by the user. The sequence of the different signal processing schemes (including the amplifier 
and cabinet warping) may be of any combination or in any order of selection. For example, the 
user may not need to do pitch modulation, thus eliminating the pitch/modulation effect generator 
78, 

[0041] The combined simulator subsystems 70 and 72 may provide a unique signal 
processing mechanism that includes features for modeling various guitar amplifiers and 
modeUng cabinet-speakers. One feature of the amplifier simulator subsystem 70 or the cabinet- 
speaker subsystem 72 is to make variations of tonal characteristics of one or more predetermined 
simulation models. A control mechanism referred to as a warp control may be applied for (1) 
both simulating or recreating tonal characteristics of original physical amplifiers or cabinets; or 
(2) creating tonal characteristics of new simulated or synthesized amplifiers or cabinets. 
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[0042] In a simple analogy, the warp control may mix at least two known audio models of 
amplifiers or cabinet-speaker sets in a manner similar to mixing at least two cans of paint. The 
mixed tonal characteristics are a combination of the initial models, just as the mixture of 
different colors of paint results in a new color. Therefore, the warp control may determine the 
amount one model should exert influence in the final mix with regard to the other. In this 
manner, the simulator subsystems can generate distinctive new hybrid amplification effects or 
cabinet effects, thus creating a new virtual amplifier or speaker model that may not exist or be 
possible in real world environments. Examples of such simulation model generation for 
amplifier simulator or cabinet-speaker sirriulator subsystem 70 or 72 is described in more detail 
in Figure 4. 

[0043] Figure 4 is a schematic for an implementation of the. amplifier simulator subsystem 
70 of Figure 3 using the DSP 26. The amplifier simulator subsystem 70 may have two amplifier 
simulators 84 and 86 formed by a group of filters that are programmed with predetermined 
algorithms. The warp control module 88 of the amplifier simulator subsystem 70 may 
manipulate the signal data going through such a group of linear and non-linear filters in order to 
complete the morphing or warping. 

[0044] In Figure 4, a five-filter system is illustrated. An input signal 89 to the amplifier 
simulator subsystem 70 is passed through a linear filter such as a 4-band biquad filter 90, a gain 
filter 92, a non-linear filter such as a spline filter 94, a level filter 96, and a 8-band biquad filter 
98. Mathematically, the filtering mechanism of each filter can be described by a formula and 
simulated by the DSP 26. For example, a one-band biquad filter may be described as: 

and a cubic rational bell-spline filter (commonly known as a spline filter) mapping an input to an 
output can be dissected into different regions based on the input where each region can be 
represented as a cubic polynomial: 

f(x) = CiX^ + CiX^ + CiX + Co . 

[0045] The spline filter takes a linear input signal and produces a non-linear output to distort 
the input signal. Because the non-linear feature of the spline filter 94 produces harmonics above 
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fundamental Nyquist rate, oversampling of the input signal is needed to reduce aliasing effects as 
a commonly known signal processing technique. The nonlinear protions of any filter may be 
oversampled to eliminate aliasing. As an example, a 32-region spline filter may take in a digital 
input between -16 and 16, whose integer portion is known as a spline segment. This integer 
portion of the input serves as an index to identify a corresponding spline region (or, a group of 
coefficients) from a data source from a memory space (e.g., lookup tables), while the fraction 
portion is the input to the polynomial representing the filter (e.g., the "x" in the above formula). 
It is noted that although the spline filter alone had multiple groups of coefficients for multiple 
regions, these groups of coefficients are still a part of a bigger set of coefficients that contains all 
the coefficients required for all components of the amplifier simulator subsystem. The warp 
control module 88 may manipulate and process the input signal 89 to the amplifier simulator 
subsystem 70 by controlling all the coefficients of relevant formulas. 

[0046] A particular set of coefficients for all relevant predetermined formulas used for all 
components either by the amplifier simulator subsystem 70 or by the cabinet simulator 
subsystem 72 can be viewed as a simulation "model." If these coefficients are set to 
predetermined values, the tonal characteristics of an amplifier or cabinet model may be 
determined. 

[0047] Therefore, it is also possible to store sets of coefficients or models in a recallable 
memory location accessible by the digital signal processor. A library containing lookup tables 
may be prepared to store these unique models. For example, a model for a British Stack guitar 
amplifier should have a unique set of coefficients different from that of an American Combo 
guitar amplifier. These models, or sets of coefficients, do not have to correspond to amplifiers or 
cabinets existing in the market. They can be for virtual amplifiers or cabinets generated purely 
based on mathematical manipulation of corresponding coefficient sets. If two simulation models 
for two amplifiers of known brands are warped to create a new model, the new model most likely 
will not match any known amplifier. Since any amplifier is represented as a model through the 
coefficients, as long as there are at least two known models, or two known sets of coefficients, a 
new model can be created. 

[0048] Using the amplifier simulator subsystem, various tonal characteristics can be 
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produced. For example, an amplifier warping feature may use two prior amplifier simulation 
models and combine them together with a predetermined control that generates new 
amplification effects. This is accomplished by interpolating each model's respective coefficients 
to create a new model. For instance, the interpolation is performed on the coefficients of each 
biquad and spUne filter in the respective amplifier simulator. This newly created model can 
function as one of the two initial models for the creation of additional models. Consequently, the 
possibilities to create new models are almost infinite, and are not limited by the availability of 
any physical amplifiers on the market. 

[0049] In the example shown in Fig. 4, a total of 12 bands of the biquad filters are used. In 
this case, each coefficient of one ampUfier may be linearly interpolated with the coefficient of 
the other ampUfier (e.g., amplifier simulator 2) using a control parameter W provided by the 
warp control module 58. Assuming that each biquad filter within the amplifier simulator 1 (or 
the first initial mathematical model) can be represented as: 

and the amplifier simulator 2 (or the second initial mathematical model) can be represented 
similarly as: 



therefore, the new model created can be represented by: 



Y,({\-W)axn*Wayn)z-'' 

H^{Z)^^^ 



l + Z((l-^)^-">*^^>-)z"' 



where W is referred to as a control parameter known as a warp parameter having a value 
between zero and one. This interpolation process is repeated on the 4 bands of the biquad filter 
before the spline filter and on the 8 bands of the biquad filter after the spline filter. 

[0050J In the sphne filter, another interpolation process is carried out. For example, if every 
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given region of the spline filter of the amplifier simulator 1 is represented as: 

5*1 (x) = flsx^ + a2Jc^ + aijc + ao 

and every given region of the spline filter of the amplifier simulator 2 is represented as: 

the linear interpolation creates the a morphed or warped signal for that region as: 
«S'3 (x) = C3X^ + C2X^ + cix + CO where 

3 

Cn = Y(^^W)an'\'Wbn 
n=0 

and W is, again, the warp parameter having a value between zero and one. . - 

[0051] As to the gain and level filters of each amplifier simulator, the signal data going 
through them are expressed and dealt with in a dB form. In order to keep the overall level of the 
model consistent as the warp parameter W changes, the gain and level filtering may also be 
linearly interpolated as dB values. Therefore, 

CGdB=(l-W)AGdB + WBcdB 
CLdB^{\'W)ALdB^WBuB 

where AcdB represents a gain filtering factor in dB for amplifier simulator 1, and BcdB represents 
a gain filtering factor in dB for amphfier simulator 2, and Ame represents a level filtering factor 
in dB for amplifier simulator 1, and Bub represents a level filtering factor in dB for amplifier 
simulator 2. CcdB and Ctde are the representations for gain and level factors for the models 
respectively. 

[0052] Similar data processing and sound effect manipulations may also be done for the 
cabinet-speaker simulator subsystem 72 (Figure 3). In one example, the cabinet-speaker 
simulator can be unplemented by a Finite Impulse Response (FIR) filter such as a 128-tap FIR 
filter. It can also be represented as: 

H{z) = flo + aiz"* +fl2z"^ + ... + ai27z"'^' 
the coefficients of which can again be controlled to produce the simulation effect desired. 
Therefore, different sets of the coefficients correspond to different cabinets, and the simulation 
model is dependent on these coefficient sets. For instance, to simulate British 4x12 cabinets, a 
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unique set of coefficients are chosen, and for American . 2x1 2 cabinets, another unique set of 
coefficients are used although the framework of the mathematical model remains the same. 

[0053] Once a cabinet-speaker simulation model is fully defined, there are several major 
signal processing control features that the cabinet-speaker simulator subsystem 72 provides to 
users. They are, among others, cabinet warping, cabinet phase shifting, and cabinet tuning, all 
intending to create more tonal or sound characteristics. The cabinet control features can simulate 
tonal characteristics of known original cabinets, which mimic actual loudspeaker cabinets using 
well-known linear system identification techniques, or generate synthesized cabinets derived 
purely by digital signal processing systems such as the system . 12. 

[0054] The cabinet warping feature interpolates the FIR coefficients of the two initial 
cabinet-speaker simulators, wherein each cabinet-speaker simulator may use one or more FIR 
filter for its simulation purpose. The result of the cabinet warping combines the tonal 
characteristics of the initial cabinet-speaker simulators to give the tonal characteristics, of a new 
virtual cabinet-speaker set. In one example, a linear interpolation is imposed with a control 
parameter known also as a warp parameter W. Assuming, cabinet-speaker simulator 1 is 
represented as: 

I 

//, (z) = GO + fliz"* + a22"^ + ... + aiZ'^ = ^GuZ"" 

and cabinet-speaker simulator 2 is represented as: 

L 

where L is the number of taps that a FIR filter has. With the warp parameter W in control, the 
interpolation results in: 

where W is between zero and one, where L=128 for a 128 tap FIR filter, and where 
co = WaQ + (l-W)bQ 

a^Wax^{l-lV)b\ 
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(0055] .ci = WaL-\-{l'-W)bL.The cabinet phase shifting feature allows a cabinet-speaker 
simulator to be shifted in time with relation to another cabinet-speaker simulator. This feature 
can be used in combination of the warping mechanism as described above. For example, this 
process may again use two initial FIR filters with L number of taps and combines them together 
with both a control parameter W that weights the two respective FIR filter taps and another 
control parameter P that offsets the taps of one filter with respect to the other. For example, the 
combined signal can be represented as: 

//(z) = |;(ffa„+(l-PF)V,)z'V 

where "p" is the offset of the coeficient set for the cabinet-speaker simulator 1 with respect to 
that for the cabinet-speaker simulator 2. 

[0056] Although the symbol "W" is used above in various formulas, it just represents 
generically a control parameter imposed in different stages of the signal processing involved and 
it may have different values in these different signal processing applications^ For example, the 
W for the amplifier models can be adjusted simultaneously with the W for the cabinet models, 
but they can be controlled separately and have different values. 

[0057] In addition to the phase shifting feature, a cabinet tuning feature appUes pitch-shifting 
techniques to certain filters' coefficients to "tune" the cabinet-speaker simulator (or the 
simulated loudspeaker cabinet). That is, by carefiiUy adjusting the coefficients, the simulation 
result equates to that caused by a change in the sample rate, thereby creating the effects of a new 
cabinet-speaker. As such, although the sample rate of the system does not change at all, a virtual 
sample rate is "created." For example, since high-order FIR filters can be used to implement the 
simulation of a new loudspeaker cabinet, and assuming a 128 tap FIR filter is used, before the 
pitch shift, the mathematical representation of the FIR filter is: 

H{Z) = ao-h mZ-^ + fl2Z-'^ + .... + fll27Z-'"^ 

where N is (1/ system sample rate). After the pitch shift, the representation is: 
/f(z) = ao + fl,z-^ +fl.z''^ + .... + a.„z-*''^ 
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where M is (1/virtual sample rate). It is understood that this virtual sample rate is a variable of 
the system adjustable by a user in order to control the amount of cabinet tuning. In effect, by 
adjusting this virtual sample rate, the user resizes the cabinet-speaker combination. This cabinet 
tuning feature may require as few as one initial simulation model. 

[0058] A refinement of the amplifier warping and cabinet-speaker warping features can be 
implemented toward a discrete frequency band. For instance, the entire frequency spectrum of 
the signal can be divided into N number of bands, and each band can have its own amplification 
and cabinet-speaker warping done separately. The user can select a frequency range of interest 
within a known model to warp into another by the techniques described above. This is also 
referred to as amplifier and cabinet frequency band split waiping, 

[0059] Figures 5-7 are circuit schematics illustrating an example of the DSP 26. 
Implementation in the form of a digital signal processor is usefiil and cost effective for meeting 
various signal processing needs. For example, the amplifier simulators with their warp control, 
or the cabinet-speaker simulators with their warp control, can be fully implemented by 
programming the DSP 26. As stated above, components shown in the entire schematic of Figure 
4 can be implemented by generating appropriate programs for the DSP 26. Commercially 
available DSPs made by any manufacturers can be similarly integrated and programmed to 
achieve the disclosed fiinctions. Furthermore, based on the degree of circuit integration of the 
DSP, a single or multiple DSP chips may be used. Although a DSP chip is described above as 
one implementation of the system, the use of the DSP is not mandatory. Any other processing 
mechanism, hardware or software, that can perform necessary calculations to effect the 
mathematical manipulations described above can be used instead of the DSP. Moreover, it is 
fully contemplated that a pure software approach may be taken to achieve all the fiinctions that 
are necessary for signal processing. 

[0060] All the programs (not shown) generated for the DSP 26 are formatted in a 
predetermined manner to be usable by any product design based on the disclosure as described 
above. In other words, the programs are portable and not exclusive to one product. Therefore, 
the programs can be shared between users of different products by the use of software and 
protocols developed for signal processing systems. For example, the Internet can be used as a 



16 



Certificate of U.S. Express Mail ino. EL828067 145 US PATENT 
Filing Date - January 4, 2002 HB Docket No. 28940.5 

USPTO Customer No. 26783 Harman Docket No. P01008US 

transport mechanism to facilitate memory storage requirements exchange of these programs by 
users. 

[0061] Figures 8-11 are sample user interfaces for the system 12 implemented, in the 
example, as a guitar signal processing device 100. For example, referring to the display 100, 
assuming the guitarist's intention is to incorporate the model of a vintage Tweed amplifier with 
an American 2x12 cabinet, and the model of a Rectified Amplifier with a British 4x12 cabinet to 
create a new model (which has its own unique set of coefficients), the following description 
explains a procedure to create and store such a model. 

[0062] First, an identifier may be assigned to represent the to-be-created model. The created 
model can be retrieved repetitively from a memory space of the guitar signal processing device 
by using the assigned identifier. Since the model is created based on two prior simulation 
models, the two models must first be selected. On the device 100 as shown in Fig. 8, two knobs 
102a and 102b, that are labeled as "Green Amp" and "Green Cabinet" respectively, are marked 
for constructing and adjusting an amplifier and cabinet combination of a first channel or a first 
model. Assuming both simulation models for the Tweed amplifier and the American 2x12 
cabinet are predefined, by turning the knobs 102a, b sequentially, the desired amplifier-cabinet 
combination can be located. For example, when turning the amplifier knob for searching the 
Tweed amplifier, the display 104 shows the term "Tweed" when it is found. 

[0063] Another display 106 shows a numeric identifier corresponding to the Tweed 
J amplifier, in this case, a numeral "6" as shown in Figure 8. Similarly, the desired predetermined 
cabinet model can be found by turning the knob 102b. Once the first initial model (the "green" 
amp/cabinet combination) is selected, the guitarist tums to select another initial model by using 
another two knobs 108a and 108b, marked as "Red Amp" and "Red Cabinet respectively (as 
shown in Figure 9). The same "knob-turning" process proceeds to find the second initial model 
(the "red" amp/cabinet combination) simulating the Rectified amplifier and the British 4x12 
cabinet combination. Once found, as shown in Figure 9, the display 104 and 106 will show 
corresponding identifiers for the Rectified amplifier and the British cabinet stack. The knob 109 
is referred to as a "Warp" knob and provides for user manipulation of the warp control function. 
By rotating the Warp knob, the two initial models are combined to create a new model. 
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Typically, the initial simulation models for the amplifier-cabinet combinations implement 
factory default settirtgs for parameters such as the Gain, EQ, and Level parameters. These 
settings may not necessarily suit the guitarist's personal taste, and may require some further 
tuning. 

[0064] As shown in Figure 10, by pressing a status button 1 10, the knob set 1 12 (including 
the knobs 102, 108, and 109) now functions as an individual control knob for multiple 
parameters such as gain, bass, mids, treble, and level for the Tweed amplifier. Likewise, by 
pressing the status button 1 10 again, the parameters for the Rectified amplifier are now ready for 
fine tuning. Using the same knob set, cabinet parameters can be adjusted. It is also possible to 
adjust the cabinet tuning for the simulated American 2x12 and the British 4x12 cabinets. For 
example, as shown in Figure 1 1, the status button 1 10 can be pressed and held until the display 
104 shows "CABTUN" indicating that cabinet tuning is available. Then, one of the two knobs 
102 may be used to fine tune the American 2x12, and similarly, one of the two knobs 108 may 
be used to fine tune the British 4x12. Once the cabinet tuning is done, the status button 1 10 can 
be pressed one more time to return the device 100 to a performance mode. 

[0065] After the first and second prior simulation models are fully programmed, the guitarist 
can create another model by tuning the Warp knob to a desired location and testing the effects by 
playing a guitar connected to the guitar signaling device 100. The newly created model can then 
be saved to a memory location as an amplifier-cabinet simulation model accessible by the guitar 
signal processing device 100 (not shown), and indexed by an identifier created by the guitarist. 

[0066] Figure 12 illustrates a graphic user interface (GUI) created by musical signal 
processing software operable with a computer such as a user's personal computer (PC). The 
fiinction of this software is to turn the PC into an external control for an audio signal processing 
system. For example, a guitarist can connect his digital guitar to the PC, which is further 
connected to a speaker set. In Figure 12, a portion of the GUI 110 is a display area 112 
identifying all information for both the amplifiers and the cabinets. Two control areas 1 14a and 
1 14b represent two models for the amplifiers and their relevant controls, and another two control 
areas 116a and 116b represent those for the cabinets. The center portion 118 of the GUI 110 
represents a control area functioning similarly as the warp control knob described above. With 
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two amplifier models located at the top and bottom and two cabinet models located on both 
sides, this center portion 118 becomes a two-dimensional control pane whereas by moving a ball 
icon 120 in the pane, the control parameters of the amplifiers, as well as the cabinets, are 
changing accordingly resulting in a "warping" feature. The warping of the amplifiers and the 
cabinets can be controlled sequentially as well as simultaneously. Once the user finds his desired 
combination, the setup can be saved in the PC or downloaded to a digital signal processing 
system as a new model. The new model is then available for the user to send to other receiving 
devices such as another PC of another user. In effect, a user can share customized model with 
others. 

[0067] In sunmiary, a system for digitally creating a new mathematical model of tonal 
characteristics is provided based on two or more initial mathematical models of tonal 
characteristics to achieve special musical effects. A first initial mathematical model of tonal 
characteristics is simulated, followed by a second initial mathematical model of tonal 
characteristics is also simulated. The creation of a new mathematical model is implemented by 
interpolating one or more coefficients of the first and second initial mathematical models and by 
adjusting a control parameter, the control parameter being adjustable in a range between a fwst 
value and a second value such that when the control parameter is the first value, the new 
mathematical model is the first initial mathematical model, and when the control parameter is the 
second value, the new mathematical model is the second initial mathematical model, and 
wherein when the control parameter is varied to a point between the first and second values, the 
new mathematical model represents a corresponding convergence between the first and second 
models. This system can be used for warping between two initial amplifier simulation models or 
two cabinet-speaker simulation models to create new models, that produces special musical 
effects when integrated with the perfomiance of a musical instrument such as an electrical guitar. 

[0068] In addition, the concept of warping between two prior simulation models is not 
limited to the applications for simulating the amplifiers or cabinets as described above. It should 
be well understood by one skilled in the art that any other DSP effects (e.g. reverb, modulation 
effects, delays, etc.) that can be simulated or represented based on a mathematical model may 
implement the techniques described in this invention. Provided that there are two prior 
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simulation models available, they can be warped in the same manner as the amplifier warping or 
cabinet warping to create a new model, thus generating distinct and/or new effects. 

[0069] The system enjoys numerous benefits. For example, it provides a digital audio signal 
processing system with simple interface for performing complex sound manipulations and the 
realistic "touch" and "feel" of real amplifiers and loudspeaker cabinets that guitarists desire. 
This allows users to customize or create virtual models for amplifiers and loudspeaker cabinets 
that may not be available on the market, or even possible to build. Thus, the artist's palette of 
sounds is broadened with infinite possibilities further providing user-unique guitar sound. This 
also allows users to not have to rely on a sound that the manufacturer of the product suggests. 
New models can be shared with others via the Internet, web pages, user's groups, etc. These 
models can then be added to a pool of existing models for amplifiers and loudspeaker cabinets 
and can then be used to further create newer models. 

[0070] While various embodiments of the application have been described, it will be 
apparent to those of ordinary skill in the art that many more embodiments and implementations 
are possible within the scope of this invention. Accordingly, the invention is not to be restricted 
except in light of the attached claims and their equivalents. 
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